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Prefatory  Note  ^ 


This  paper  is  based  on  an  invited  address  given 
by  Dr  Paul  W.  Caro  of  HumRRO  Eastern  Division 
(Pensacola.  Fla..  Office)  at  the  Third  Flight  Simu- 
lation Symposium  of  the  Royal  Aeronautical  Society 
•in  London,  England,  on  April  8,  1976. 

Dr.  Caro  is  Manager  of  HumRRO’s  flight  train- 
ing research  and  development  activities,  and  was  one 
of  only  two  Americans  to  present  papers  at  this  sym- 
posium  on  “Theory  and  Practice  in  Flight  Simulation. 
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SOME  FACTORS  INFLUENCING  TRANSFER  OF 
SIMULATOR  tRAINING 

Paul  W.  Caro 

Human  Ratourcet  Rawarch  Urgani<atton 


INTRODUCTION 

'I'lit*  iist>  ot  $imul.tU>r!i  and  othtT  Iraintni;  devicfs  is  tni-reasin^  rapidly.  Ona  assiiinas 
that  this  phenomenon  is  intended  to  enhanee  the  effectiveness  ard/or  the  efficiency  of 
the  truinini:  programs  in  which  such  «tevice«  are  us«>d,  Init  the  seriousness  with  which 
simulator  makers  and  users  pursue  this  intent  miitht  well  tie  ipiestioiUHl  from  hoth  the 
practical  and  scientific  points  of  view.  Following  a stiuly  of  the  use  of  aircraft  simulators 
in  selected  U.S.  military  ami  civilian  pilot  traininit  proerams.  the  C'oiiiptroller  General  of 
the  Dnileil  States  recently  issutxl  a report  to  the  ('oni;Ti*sS  whicli  was  critical  of  the 
extent  to  which  simulators  are  tieuiii  used  in  the  military  trainim;  proi^'ams  studied  (1). 
'Ihe  report  siifti'ested  that  present  knowlinlue  of  simulator  desitjn  aiul  employment  is 
sufficient  to  support  much  more  extensive  use  of  simulators  than  was  typically  found  to 
he  the  case.  The  report  cites  certain  pilot  Irainin;*  :i;;eiu‘ies  which  M‘ein  to  employ  that 
knovvleil^e  nuire  effectively  than  do  others,  even  tlioU)ih  the  knovvlei!i;e  is  availahle  to  all. 

The  Comptroller  General  report  was  not  intended  as  a .scientifie  study  of  psy 
cholo^icul  factors  and  their  influences  on  simulator  tminintt  effeeliveness.  Instead,  it 
identified  factors  related  to  the  munuttement  of  simulator  trumin!’  and  altitudes  towaiJ 
such  IrainiiiK  which  tend  to  impede  more  extensive  use  of  simulators.  Fiictors  identified 
include  reculatiuns  emphasising  aircraft  rather  than  simulator  training,  inadei|uate  insiruc 
tor  training,  failure  to  use  simulator  capabilities  fully,  and  ptuir  simulator  maintenance. 
Itie  influence  of  such  management  factors  u|Hm  trainer  use  has  been  documented  in  the 
riKearch  lilendiire  (eg  , 2,;t)  Other  factors  winch  have  Iwvn  ulentifieil  as  imivedimenls  to 
effective  simulator  use  iiulmle  ll.t'  ile-,i(.n  of  ih«>  siii'iiiaters  iheiiiselvi's  and  of  the  traiim.; 
programs  in  which  the  simulators  are  einployeil  (e.g.,  4,h).  Still  other  fwtors  have  been 
reported  which  influence  the  acceptance  of  simulators  hy  tluise  who  imtst  use  them  and 
thereby  indirwtiy  impede  their  more  extensive  use  (e.g.,  t»). 

Clearly,  the  intent  of  simulator  users  is  to  acliieve  effective  training  rather  than 
merely  to  use  training  cnuipmeiit  extensively.  It  is  |H>ssible,  howtwer,  to  use  simiil.di'rx 
extensively,  while  at  the  same  tune  to  use  them  iiuTfectively.  In  one  study  (71,  for 
exanipli*,  it  was  found  that  the  extensive  use  of  a p.irticular  device  added  cost,  hut  no 
training  value  to  an  idremly  es()cnsive  pilot  training  program.  Another  study  demon- 
strateil  that  the  training  value  of  a device  eoulil  he  increased  .suhstanlially  without 
increasing  the  amount  of  device  training  time  involved  when  Ihe  imunier  in  which  it  was 
used  was  changed  (8). 

While  there  is  u great  deal  of  scientific  and  training  literature  in  existence  dealing 
with  simulator  training,  some  of  the  more  significant  factors  influencing  transfer  of 
simulator  training  have  not  received  the  systematic  attention  they  warrant.  The  pur|H>se 
of  this  paper  is  to  call  attention  to  certain  of  the  factors  ohservixl  over  (he  last  dec.uh'  to 
he  of  significance  iii  our  simulator  research  and  (hat  of  our  profi*ssional  colleagiu's 
elsewhere.  The  emphicsis  will  he  upon  increasing  the  effictiveness  of  simulator  training  as 
opposed  merely  to  increasing  simulator  use.  While  simulator  effiH-liveness  anil  use 


I 

Best  Available  Copy 


ulivuttKiy  «u<>  not  in  U'pi*iul<*nt  (n  ^ttuulaU■t  t .iiiiiol  I*'*  ttsml  I'fl'iH'tkvely  it  is  usawt 

Lttic  or  not  at  all),  'ney  am  t\ot  always  i oihiih  Miioilatur  anti  ustrn 

appear  uniiw.u«  i>f  fat  tors  which,  if  propitrly  trcatctl  ttr  inaiu^icti,  wtiuU  iiiaikMily 

t'liliaiu-a  th»  vatu*  utul  cfficianty  t>('  Minulalor  trau\m|{  prttKraiiu  'l'h»  iniftirtuiiata  con.s«- 

i)iu‘ni'<>  ttf  their  lack  of  awaieniras  is  that  simulatttr  traiiiin)(  cfftn'tiveintM  Miffers:  skills 

which  may  hn  cntical  to  safe  o^iemtion  of  an  aircraft  mav  iiol  he  tleveloiinHt;  aircraft  may 

he  r<‘<|uiretl  imnect>ssanly  for  trammu  when  they  are  neetletl  hir  other  |Htr(Hises;  IramuiM 

ctists  hecotne  escessivw;  or  simulator  tramiiiK,  althoiiKli  effective,  is  tsiiKlucletl  m an  1 

inefficient  inannvr. 


MhASURIiMG  SIMULATOR  TRAINING  EFFECTIVTNbSS 

In  order  to  idcntir^'  factors  which  uitluence  simulator*  trumui|(  cttectivenesa,  it  u 
necessary  to  measure  those  influences.  Since  simulator  training  effectiveness**  is  not 
independent  of  the  extent  to  which  the  device  is  usetl,  one  iiidtcalioii  of  whether  a factor 
can  he  influential  is  to  determine  how  much  u simulator  tramuiH  prom-tm  einbiHlyinit  that 
factor  is  used,  e.g.,  the  elapsed  time  that  the  device  is  in  use,  or  the  iiumliet  of  tasks 
pnicticed  in  it.  While  simulator  training  cannot  l>e  effivtive  if  these  v.klues  et|ual  aero, 
hi^ih  indices  of  use  do  not  indicate  effective  sinuilator  trnmnii  V‘.ve;i  unproved  pilot 
p«'r:.iii:i.i>\ce  m the  MinulaUir  resulting  from  its  Use  ilocs  mU  .i...auc  itnpu>ved  |<erroii:iaiice 
in  the  aircraft.  Therefore,  measures  must  be  iiseil  which  lelicct  iinpiuveinents  in  pilot 
tierformance  m the  uircraft,  not  how  proficient  the  pilot  hivame  at  flytnti  the  simulator 
or  how  much  trainuig  he  receiveil  in  it. 

The  Transfer  Modal 

« 

The  transfer  of  training  model  can  lie  cmployeil  to  determine  whether  simulutor 
trnmmg  luu  improved  siilise<iiient  pilot  performance  in  an  mrcnift.  'I'ransfer  of  training  is 
a phenomenon  which  occurs  whenever  the  existems'  of  a previously  learmHl  liehavior  or 
skill  has  an  influence  upon  the  acquisition,  perfornuuice,  or  relearning  of  a Mvond 
behavior  or  skill.  Thus,  if  a behavior  Icanu'd  in  u device  lues  an  mfliiem'e  n|>oii  the 
subsei|uent  acquisition,  performance  or  relearning  of  behavior  m an  airplane,  transfer  is 
said  to  have  occurred . 

A simple  expenmental  design  huseil  upon  the  trunster  of  trammg  iiUHtel  involves  two 
groups  of  trainees;  an  experimental  group  which  receives  smuilalor  training  poor  to 
further  training  or  performance  testuig  in  the  mrcraft;  aad  a control  group  which  uveives 
all  its  training  in  the  aircraft.  This  design  permits  measured  rhtferenci‘s  in  |H*rformaiice  in 
the  aircraft  between  the  expenmental  and  ixtntrol  group.s  to  In'  altnhuteii  to  the 
influence  of  training  receiveil  in  the  simulator  by  the  expenment.il  grmip.  1'he  groii{ia 
must  be  equated,  of  cotinie,  in  terms  of  relevant  prior  Iraimng  end  ex|ienences,  aiul  a 
means  for  measuring  in-flight  performance  must  be  available. 


*Many  wriUn  ilutmxuuh  Iwtwvvn  ciinuUlor*  (v  x , . a hi|ih  (fi-xw*  »(  l■>t•v4a•-•  to  ottmnlicmsl 

•quipmsni.  . .")  and  Iraining  dvvicss  (eg  , ”.  . sny  uwi-*  «(  dpusiatu*  whu-h  is  uivd  f**  Irsmnig. . 

Ik*  prvMnt  wiitar  will  treat  these  eiamples  «>(  trsining  e<|uipnisnt  as  iiieiiihern  of  s smale  cUss  Ttf 
quote  (isgne  (d,  p.  9e),  the  suurre  sbu  of  the  above  <iitotAlions,  ''Wh.it  distincu.shes  s Irsinina  device 
(from  other  trsintna  equipment)  is  not  its  spiwsrance  or  *-o«>l ruction,  hut  r.ilher  Vue  end  /or  u’hut 
pur/>oscs  it  is  used."  The  term  simulatur  is  used  here  to  tdeiilify  iiroiiiul  heseil  tiiunist  equipiiient  used 
(or  lilt  purpose  of  training  pilots  to  Hy  siremft  The  question  of  how  it  u used  will  he  mhltessed  in  the 
psprr 

**.  . . or,  ss  more  propeily  sleleil  hy  deAntheau  ( KM,  the  rffrclivenesA  of  Iteming  with  the 
liiiiiilAtor.  . . 
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UthtK  ApprcMchm  to  UoMrmintui)  Simiilatui  Tiaininy  fflectiMOMs 

DfterniininK  lha*  (*tfe('tivt>iu‘v>  of  simulator  trainiiiy  can  lio  a cosily , tima^consuinmii 
task  if  an  in  tliHht  iicrfortnunct*  measurement  system  is  not  ri'atlily  aviuUbl».  Som» 
analysts  have  attempieil  to  conduct  sunulatur  evaluations  hy  askiny  pilots,  instructors, 
traininx  snecialisU  and  even  students  their  opinions  cuiuvmintt  simulator  effectiveness, 
i.e  , the  prohalile  impact  upon  student  (lerformaiuv  of  trauiir.|(  iii  the  simulator.  I have 
observed  instances  in  which  surveys  of  pilots*  aiu’  instructors’  opinions  yielded  results 
(holh  pro  and  con)  unnMated  to  data  suhserpientl^  ohtameil  in  transfer  studies  invoivinii 
the  devices  in  itueslion.  Meister.  Sullivan,  Thompson  Finley  il)  found  that  such  an 
approach  yielilesl  different  i>stiinales  of  the  effcv-tueness  of  a piuticular  device  where 
different  instructors  made  the  judumenU  invoive>l  Instructor  evaluations  of  simulator 
effectiveness  are  iinreliahie.  pruliabiy  due  t»»  attitude  f„ctot<  such  as  thos»>  tliscussed  by 
Mackie,  ct.  al.  (b),  as  well  as  because  of  the  inherent  iiiirehability  of  judgments,  and 
should  not  be  tiseii  where  much  is  at  stake  Simuiaior  efft'Cliveness  is  a matter  of  trainee 
iii'fliHht  performaniv,  not  of  instructor,  pik>t.  ur  trainee  t'pinuins  about  the  device  and  its 
proliable  usefulness. 

Another  simulator  evaluation  technique,  liackward  or  invi>rse  transfer  of  traininn,  has 
lw>en  desenbeil  by  Adams  and  MeAbeell*,!).  In  a backward  (ransrer  study,  a pilot  who 
has  already  demonstratiHl  mastery  of  m flight  trainiiiK  objectives  is  “tninsferTeil"  to  the 
simulator  where  he  is  requiretl  to  pt*rf«»nn  tasks  eorrespondintt  to  thOM*  he  has  inaster»H.I 
III  tlie  ainraft.  If  he  can  jierform  such  tasks  at  criterion  levels  in  the  simulator  without 
practice  there,  backward  transfer  is  saitt  to  have  occurred,  and  this  fact  is  taken  as 
evidence  that  transfer  m the  simulabir  (oslevuv  mjueiice,  nllhoiii;h  of  unknown  quantity, 
will  be  positive.  The  Ivickward  transfer  design  should  Ih‘  iise.l  with  caution  for  at  least 
Ihri'e  reasons:  (a)  the  results  assunie  (often  iiicorrvH'tly)  that  a suitable  training  (irogiain 
exists  for  the  simulator;  (b)  ex|ierieiuxHi  pilots  already  proficient  at  ojienitional  tasks 
often  have  generalutHi  skills  not  possessixl  by  riYent  gradiiat<*s  and  may  be  able  to 
transfer  to  the  tieviee  liev'ause  of  such  geiu<ral  skills  rather  than  skills  lux'dixl  to  pilot  a 
jvirtioular  aiix'raft  or  |u>rform  a particular  mission;  and  (c)  tlie  simulator  may  lie  siiitahly 
desigiitxl  for  the  perforniaiu'e  and  evaluation  of  a particular  set  of  behaviors  but  may  lack 
tlie  cues  essential  lo  the  development  of  those  liehaviors.  While  backwanl  transfer  data 
sluiutd  not  be  the  snde  justificaboii  for  M iietilivr  j'roeiireiiieiil.  one  would  be  hv'sit.mt  to 
Use  a siinulatoi'  vvhicb  coiiM  not  be  o|H>Tateii  by  eoin|H>teiil  pilots. 

.leaiitheau  (10)  has  describisl  four  apinroaehes  to  simulator  evaluation:  (a)  conduct  of 
a transfer  experiment  as  is  descnlied  above;  (b)  analytic  study  of  the  il:*viee  and  its 
pnignim  of  instruction;  (c)  use  of  the  d«*vsce  without  expixiiiieiital  controls  which  would 
permit  measurement  of  its  effectiveness;  and  (d)  comparison  of  various  ways  of  using  tlie 
device.  These  latter  thn*e  apjiroaches  an*  appropriate  lo  assuring  that  a siiiiulntor  is  iisetl 
cornx'tly,  but  they  do  not  yield  ilata  which  ds'iiionstrate  that  pilots  who  are  trained  in 
the  simulator  an*  more  iximpetent  than  pilots  who  are  not  so  traimxt.  Sometinit>s  such 
approaclu*s  must  l*«*  relied  iqioii  for  admiiiislrative  reasons  or  hecausi*  experimental 
(Xintrals  involve  unacceptable  risks  (e.g.,  the  effectiveness  of  lunar  landing  siinuliitora 
could  not  lie  determined  in  a study  involviiig  a iio-simulator-tniiniiig  control  group). 

The  fact  that  .simulator  training  rcMVirch  cannot  tdways  involve  transfer  to  an  aircraft 
is  not  necessarily  all  bad.  Many  n*s»*an*h  issues,  including  issiu's  rolaled  to  efficient 
methods  of  siiiiiilator  training,  can  U*  mvestigalixl  in  siniiilators  and  lalHiratories  lo 
vxinsiderable  advantage.  A higher  ilcgree  of  vxiiitrol  can  In*  exercised  owr  independent 
variables  m such  stuilies,  and  the  cost  of  ain'r.ift  ojiernlioiis  can  be  nvoidixl.  The  chief 
disadvantage  lies  in  the  n'siilting  iincert unity  concerning  the  effectiveness  of  tliat  tT.uiiiiig 
in  the  operational  situation.  Kecent  efforts  of  Malheny  (l.'l)  on  porccptii.il  eqiuv.ilence 
ni:iy  offer  a means  of  testing  simulator  efrectivoiu*ss  without  costly  tiaiisiVr  sltidu's. 
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A niimlif'r  t>f  ;ui.jlytic  n\oilfU  have  been  Mly^;e.sle^l  fnr  itrediclin^  .iiiniilabir  (’fb-t  live- 
niws  11  1,  ir»,  10,  I VI,  but  none  of  them  hikes  into  {mtoiiiiI  nil  of  the  fnclofs  belit*ve«l 
relevant,  Tl'.ey  are  useful  in  desinnink;  simulators  aiul  Iraininn  |’r();:r.un:.,  but  lliey  tlo  not 
nuv.suri*  simulator  effectiveness  and  estimates  based  uj?on  tlieni  are  subject  to 
unknown  error. 

Intlices  of  Simulator  EHttctivantns 

Various  formulae  have  been  suft^ested  to  express  simulator  effectiveness  as  a single 
value.  Gajtne,  Foster  & Clro\vley(l8)  proposed  nine  such  formulae,  coiTespondinj^  to 
different  op>erations  involved  in  (lerivinji  the  raw  data,  e.^;.,  eountinjt  trials,  mexsurinu 
time,  or  counting  errors.  Si.x  formulae  have  been  .suggested  by  Murdock  (19)  and  five  by 
Hammerton  (20),  each  of  which  deals  with  .specific  experimental  tlesi.gn  and  data 
problems.  .An  index  which  Lakes  into  account  the  amount  of  effort  involved  in  device 
training  as  well  as  subsequent  in-flight  perfortnanco,  the  'rrnnster  Kffeetiveness  Ratio 
(TSR).  has  been  proposed  by  Povenmire  & Roscoe(2l).  A variation  of  the  'I’FR  take's 
into  account  the  relative  cost  of  simulator  vs.  aircraft  training  (22).  While  all  such  indices 
provide  a means  for  comparing  simulator  effectiveness,  they  cotdrihute  little  to  our 
understanding  of  the  training  value  of  .simulators.  The  raw  data  themselves,  a dc.scription 
of  circumstances  under  which  the  measures  were  m.ade,  and  idenliriculion  of  the 
flcp*'n(!ent  variables  are  more  useful  in  understandin;.*  factors  inriuenciti;'  simulator  train- 
ing. If  n single  inde.<  is  nece.ssary,  it  might  better  be  one  which  icriecU  the  cost  .savings 
resulting  from  the  use  of  the  device  in  a specified  way  in  n piuticular  tr.aining  program. 


FACTORS  INFLUENCING  SIMULATOR  TRAINING  EFFECTIVENESS 

A recent  summary  of  simulator  training  studies  (d)  indicated  that  sitnulalor  Irainiag 
pffectivenes.s  has  increased  markedly  .since  World  War  H.  Some  of  the  increase  can  be 
attributed  to  advances  in  engineering  and  inslnictional  design  techiu>Iogies.  Simulation 
engineers  nOw  have  the  technology  available  to  Iniild  simulators  which  more  nearly  satisfy 
Thorndike’s  common  elements  design  hypothesis,  and  instrnclional  .sy.stem  desigMcr.s  Imve 
learned  how  to  zero  in  on  t.asks  to  be  trained.  Rut  much  of  Ilur  increase  has  come  ahoiil 
as  a result  of  research  and  experience  with  .simulators  in  operational  training  scttinjjs. 

In  .spite  of  the  large  number  of  .simulator  effeetivene.ss  studies  which  have  been 
completed,  there  remains  much  to  be  learned  about  training  willi  these  devices.  Factors 
luve  l>een  nominated  as  influences  upon  .simulator  training  effectiveness,  but  many  of 
tho.sp  nominations  have  been  based  on  inference  rather  than  experimental  evidence.  In 
their  review  of  simulator  research.  Muckier,  Nygaard,  O’KclIcy,  aiul  Williams  noted 
tliat  many  studies  compound  tlie  influence  of  .several  potential  innuences  sucli  as  training 
program  content,  instructional  technique,  and  instructor  qualification,  into  a single 
independent  variable  .so  that  the  transfer  effects  can  be  altviluited  only  to  tlie  unique 
combination  of  those  influences.  F.ven  in  the  few  experimental  investigations  which 
isol.ate  :u«umed  influences,  the  re.sults  must  he  interpretiHl  eanliou.sly  because  they 
addre.v;  unique  training  requirements  and  have  not  been  replicaltxl. 

The  methmlological  problems  involved  in  identifying  factors  wliieli  inHuenco 
simulator  training  effectiveness  cannot  ea.sily  be  overcome.  Suspected  factors  can  selilom 
be  examined  in  isolation.  It  i.s  difficult,  for  example,  to  determine  experimen tallv  the 
relative  value  of  a remote  instructor  station  vs.  an  on  board  or  in  Ihe-cockpit  .slat am  even 
if  a suitably  designed  .simulator  were  available  fur  the  research,  hi'cau.se  to  use  each 
station  to  its  best  advantage  would  nece.isitate  liaving  two  metlunls  of  trainiuj;:  one 
optiiui/cd  for  remote  instruction;  the  other  optimi.'ed  for  onboard  instruction.  'I'ln' 
experiment  would  thus  compare  instructor  station-training  program  combinations,  not  a 
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simulator  design  feature  in  isolation  from  other  factors.  The  training  program  factor 
cannot  be  held  constant.  It  would  be  inappropriate  to  compare  two  simulator  designs 
asing  a program  optimized  for  only  one,  or  for  neither. 

The  problem  of  generalizable  results  is  not  limited  to  studies  involving  operational 
simulators.  Even  using  equipment  designed  and  dedicated  to  research,  problems  arise.  For  * 
example,  to  pursue  the  illustration  of  instructor  station  location  described  above, 
simulator  hardware  inflexibility  makes  it  difficult  to  conduct  the  necessary  research 
leading  to  the  design  of  the  optimum  remote  instructor  station  for  experimental  com- 
parison with  the  optimally  designed  on-board  station.  Additionally,  the  on-board  station 
design  which  is  optimum  for  a single  seat,  high  performance  attack  aircraft  simulator  with 
a visual  display  may  bear  little  resemblance  to  the  optimized  on-board  station  for 
undergraduate  instrument  training  in  a side-by-side  seating  helicopter  simulator. 

Definitive  data  do  not  exist  which  will  permit  the  quantification  of  the  influence  of 
all  factors  believed  to  influence  simulator  training  effectiveness.  In  fact,  the  mere 
identification  of  most  such  factors  rests  upon  inference,  conjecture,  and  untested 
hypotheses.  The  absence  of  hard  data  obviously  cannot  justify  suspected  factors  being 
ignored,  however.  Where  inferences  can  be  made  and  supported  by  consensus,  factors 
believed  to  influence  simulator  training  must  be  taken  into  account  by  those  responsible 
for  simulator  design  and  use  unless  evidence  can  be  assembled  to  refute  those  inferences. 

It  is  the  responsibility  of  the  research  community  to  undertake  the  systematic  investiga- 
tion of  such  factors. 

The  folic  wing  discussion  is  intended  to  call  attention  to  selected  factors  which 
influence  simulator  training  effectiveness.  U would  not  be  fruitful  to  attempt  to  cite  all 
the  researchers  who  have  contributed  to  the  identification  of  such  factors— those  who 
have  contributed  to  the  literature  on  physical  vs.  psychological  variables  in  simulator 
design,  for  example,  are  legion,  as  are  those  who  have  remarked  upon  the  importance  of 
how  the  simulator  is  used.  Review  articles  touching  on  the  subject  include  references 
no.  2,  3,  23,  24  and  25.  Except  where  specific  reference  is  made  to  a particular  report, 
the  present  writer  will  acknowledge  responsibility  for  the  inferences  set  forth  herein,  as 
well  as  for  the  selection  of  factors  to  be  discussed. 

Simulator  Design 

There  are  two  areas  of  interest  with  respect  to  the  influences  of  simulator  design 
upon  transfer  of  training;  fidelity  of  simulation  and  design  for  training.  Fidelity  refers  to 
whether  features  of  the  aircraft  and  its  environment  are  included  in  the  simulator’s 
design,  and  the  extent  to  which  features  which  are  included  represent  or  duplicate  their 
real  world  counterparts.  Design  for  training  refers  to  the  inclusion  in  simulator  design  of 
features  or  configurations  which  facilitate  training  but  which  may  bear  no  particular 
resemblance  to  features  of  the  aircraft  and  environment  being  simulated. 

Fidelity  of  simulation  is  often  equated  with  physical  correspondence  between  the 
device  and  its  real  world  counterpart.  In  their  discussion  of  simulator  design  considera- 
tions, however,  Smode  and  Hall  (26)  emphasize  instructional  strategies  and  capabilities 
and  suggest  that  fidelity  has  meaning  in  terms  of  the  process  and  the  realism  necessary  to 
promote  learning.  Design  characteristics,  they  assert,  should  be  defined  in  terms  of 
assuring  transfer  of  training.  In  other  words,  fidelity  of  simulation  is  a matter  of  the 
relevance  of  the  simulation  to  the  training  objectives,  not  solely  a matter  of  jiiiysical 
correspondence.  This  concept  of  fidelity  accounts  for  the  effectiveness  of  so-called  low 
fidelity  devices  as  weU  as  simulators  that  faithfully  reproduce  much  of  llie  aircraft. 

Design  for  Training.  The  Smodc.  and  Hall  concept  of  fidelity  is  of  particular  interest 
with  respect  to  simulator  features  not  modeled  after  the  aircraft.  These  fentures,  v.liich 
are  concerned  primarily  with  application  of  principles  of  learning  to  the  training 
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iiu'ludt*  freeze,  aibptui*  training,  pruniptinx  and  t-.n*;:;;.  i^-rfur.naiu'e  nfordir^  and 
pUvhaak,  prr'ormunc*  m**.ijur  *tn>'nt,  and  various  in-triiftof  ^tat'on  displays  and  controls. 
It  IS  ^>.'it«rally  held  that  sueh  features  improvt*  the  conditions  under  which  le.irniR**  takes 
p!,u'i*  and  liii-rei>y  facilitate  the  alt;un;neiil  of  training  ul>jei  tives.  'I'lierefore,  they  are 
factors  to  he  considered  in  judging  the  fidelity  of  a device  so  far  as  training  is  concerned. 

It  is  general  practice  to  adopt  innovative  simulator  design  features  such  as  those 
mentioned  above  on  the  basis  of  their  apparent  utility  without  sahjecUng  them  to 
e.xperiinentai  scrutiny.  For  example,  the  widely  used  simulator  freeze  feature  was 
implemented  because  it  was  seen  as  an  aid  to  attaining  training  objectives  and  to 
implementing  teammg  concepts  during  the  instructional  process.  Similarly,  other  design 
decisions  are  made  because  the  training  objectives  luiU  planned  concepts  of  simulator 
employment  lead  to  the  conclusion  that  a particular  design  is  appropriate  in  preference  to 
others.  For  example,  in  the  design  of  U.S.  Army  simulators  for  the  Vertol  CH-47  and  the 
Bell  AH-1  helicopters,  the  instructor  stations  were  located  virtually  inside  the  cockpits  of 
these  devices,  and  certain  instructor  displays  were  |iositione<l  so  that  Uiey  could  be 
viewed  by  both  the  instructor  and  the  trainees  in  order  to  facilitate  iiutructor-Uoinee 
interactions  during  key  training  activities.  The  training  effectiveness  of  these  features 
probably  will  never  be  determined  in  a transfer  experiment  for  the  methodology  reasons 
discussed  above.  Analytically,  they  are  believed  to  represent  effective  simulator  designs 
with  respect  to  the  Army's  training  program  and  the  training  objectives  to  be  addressed. 

Vu  ial  Fictality.  Cienerally,  v.hich  cannot  he  vLip'.icatetl  or  even  approxiinaled 

in  a device  cannot  be  learned  there  for  subsequent  tninsfer  to  the  aircraft.  Therefore,  a 
simulator  in  which  more  tasks  characterizing  flying  can  be  [leiformcd  has  greater 
potential  training  effectiveness  than  one  in  which  fewer  such  tasks  can  be  performed.  For 
example,  a simulator  which  does  not  include  an  extra>cockpit  visual  display  would  seem 
to  have  less  effectiveness  potential  with  respect  to  training  tasks  requiring  visual 
references  than  a simulator  with  such  a display. 

There  have  been  a number  of  studies  in  which  transfer  from  a simulator  wiU\  a 
visual  display  has  been  demonstrated.  The  scenes  presented  by  some  of  these  displays  are 
much  simpler  than  scenes  viewed  from  an  aircraft.  For  example,  savings  in  aircraft  time 
required  to  perform  visual  reference  maneuvers  were  demonstrated  in  a study  by 
Flexman,  Matheny  & Brown  (27)  using  a simulator  with  a visual  dispby  condsting  of  a 
line  drawing  on  a blackboard  placed  m front  of  the  cockpit  and  tilted  by  an  instructor  to 
change  perspective  as  the  device  was  maneuvered  with  ri'spect  to  simulated  ground 
references.  The  effectiveness  of  other  simple  displays  consisting  of  stylized  grids  and  lines 
has  been  demonstrated  in  backward  transfer  situations  diuing  studies  of  contact  analog 
dispbys  developed  for  helicopters  (2S).  Displacement  of  scene  elements  consisting  only  of 
dots  and  lines  was  found  by  Thielges  and  Matheny  (29)  to  provide  sufficient  information 
f'r  the  performance  of  aircraft  control  tasks,  although  their  study  was  not  based  on  a 
transfer  model. 

These  studies  indicated  that  tasks  involving  aircraft  control  in  relation  to  extra- 
cockpit  visual  information  can  be  practiced  effectively  in  .simulators  with  very  simple 
visual  scene  dispbys.  The  dispbys  consisted  of  no  more  than  points,  lines  and  geometric 
patterns  arranged  in  accord  with  a set  of  mathematical  relationships  described  by 
Gibson  (30).  Several  manufacturers  currently  are  taking  advantage  of  tlw  utility  of  these 
simple  scene  content  design  requirements  by  marketing  displays  which  represent  night 
scenes  as  patterned  poinb  of  light  on  a bbek  field,  and  their  dispbys  are  being  used  wiUi 
apparent  success  in  commetcbl  airlines'  simulator  training  programs. 

While  the  effectiveness  of  such  simple  visual  displays  has  been  demonstrated  to  the 
extent  described  above,  it  is  also  noted  that  simulators  without  a visual  display  can  be 
effective  in  the  training  of  visual  reference  flight  tasks.  In  a study  involving  a helicopter 
simulator  without  a dispby  or  any  other  representation  of  outside  viswd  cues  except  the 


Best  Available  Copy 


aircraft*::  navigation  aiui  attituile  ttiNlruinents.  and  without  any  attention  during  simulator 
trauiing  to  extra-cockpit  visual  cut's  per  se.  students  troiiufd  to  fly  instrument  fliHiit 
missions  in  the  tlevice  qualified  in  the  aircraft  under  visual  conditions  more  rapidly  than 
did  students  not  receiving  the  prior  device  trainmit  (iU).  In  a siindar  study  using  a fixed 
wing  simulator  without  .1  visual  display,  .1  saving  in  visual  flight  time  requued  to  complete 
a transition  course  of  approximately  of  the  M-heiluIevl  course  length  was 

obtained  (8).  An  unreported  study  by  the  ll.S.  Air  Force  involving  cogiiiUve  training  m a 
simulator  with  no  visual  display  demonstrated  transfer  to  visual  flying  maneuvers  such  as 
traffic  patterns  (32). 

While  It  is  not  indicated  by  these  studit's*  r<‘sults  that  visual  displays  have  no  training 
value,  it  appears  that  many  behaviors  ret^uired  as  responses  to  extra-cockpit  visual  stimuli 
in  the  aircraft  cun  tie  practiced-or  at  least  approximated— m response  to  stimuli  in  a 
simulator  without  on  ouUide  display.  Further,  cockpit  iiistrumenU  provide  uifomiation 
about  and  an  analog  display  of  the  visual  world  outside  the  cockpit,  so  a pilot  flying 
instruments  is  responding  to  stimuli  analogous  to  those  available  to  the  pilot  flying 
visually.  At  least  some  of  the  simulator  effectiveness  attributeil  to  the  simpler  visual 
displays  probably  would  occur  without  the  presence  of  such  a display  at  all. 

Uunng  the  current  review,  no  studies  were  found  which  unequivocably  established 
the  effectiveness  of  any  extra-cockpit  visual  display.  While  transfer  studies  involving  visual 
dis)ilays  were  found,  only  one,  an  exploratory  study  juvlgeil  inconclusive  by  its 
authors  (33),  includesi  a control  group  in  which  students  were  t;aiued  in  the  simulator 
without  using  its  display.  Commericai  uiritnes  have  reduced  aircraft  training  time  fol- 
lowing the  addition  of  a visual  display  to  an  existing  simulator,  but  some  if  not  all  of  the 
reduction  resulted  from  a priori  judgments  by  government  agencies  imd  the  airlines 
themselves  concerning  increased  simulator  training  effectiveness.  In  no  cases  have  there 
been  reports  of  efforts  to  design  training  programs  which  would  seek  the  same  flight 
training  savings  using  simubtors  without  visual  dispbys  that  presumably  have  been 
achieved  using  simubtors  with  such  dispbys. 

The  lack  of  evivlence  of  visual  dispby  training  effectiveness  cunr.ut  be  taken  as 
evidence  of  their  bek  of  effectiveness.  3‘herp  is  a coiisensus  that  they  ore  effective,  and 
data  to  conte.'it  that  cuiiseii.sus  do  not  exist.  la»gio.illy,  it  woulti  appear  that  an  extrn- 
ccrkp't  v^uiil  dispkiy  is  ;m  effective  w;»y  to  present  visual  information  used  in  some 
o{ieratin:i.d  lUiks—such  cs  on  a car.icr,  t.uviitii;,  n fueling,  delivering  certcai  ku'.ils 

of  weapons,  and  air-to-air  combat.  In  some  instances,  it  may  be  the  only  effective  way. 
In  others,  it  may  be  effective,  but  ineffleient,  tiarticiiloriy  when  cost  is  taken 
into  consideration. 

Motion  Fidelity.  Not  much  more  is  known  alKiiit  the  influence  of  motion  upon 
simulator  training  effectiveness  than  aliout  visual  dispbys.  Although  motion  simulution 
has  represenlerl  a significant  portion  of  the  cost  of  simulator  procurement  and  operation 
for  a number  of  years,  the  investigation  of  the  influence  of  motion  ii|Hin  simulator 
training  effectiveness  has  Iteen  hugely  ignored.  The  first  significant  study  involving 
simulator  motion  in  the  transfer  of  pilot  training  was  rcporteil  in  li)75  by  Jacobs  and 
Koscoe  (34). 

The  results  of  the  .lacolis  and  Roscoe  study  provide  evidence  that  transfer  may  not 
benefit  from  the  presence  of  normal  wwliout  cockpit  motion.  In  that  stiuly,  training 
received  in  a two-axis  normal  washout  motion  condition,  compareil  with  training  in  the 
same  device  without  motion,  resulted  in  non-sigiiificant  diffetenivs  in  amount  of  transfer 
to  the  aircraft  for  these  two  conditions.  Then*  wjus  how«*ver,  significant  (Hisitive  transfer 
fur  both  motion  and  nu-niolion  comlitiuns.  SimiLir  results  have  been  oblnituil  in  an 
unpublishtxl  ll.S.  Air  Force  undergrailu.ite  pilot  training  study  involving  a more 
sophistical cil  .six-axis  inofivui  system  (3'.!). 
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l i'.'  .I.n'.  ill  I’t'woi*  that.  Ir.aii-v^.  th.«"  ('.'•  ''•'E  i «*  iif 

i.:  .1  f.’.ay  tu»l  (r.ii.iiit;;  mi.jt  Iv  trvtul  auli  i .jMtiori 

u.iM  furt.'ier,  tluTi*  ar»*  <>tt\*T  Uut,  il  I ’»t  r 

t motion  may  h«*  ovi-ti  u'  not  • For  ovaiiui'e. 

F.  ■'! -r  oil  roportcil  a sU^tht  ail'.anUi^iE  in  f.i-.or  ot  .1  inoiiun-aiiniiloUN'  ti.tinnl 
HI  T .1  iKi-inotio.'i  i;ri)up  ilurin:.t  bncf  traiiaTer  lioverin.;  j helicopter.  Ittoro 

laip  t .iitly,  pethap-i.  the  motion  inroup  la  ho  stuJy  n-.a-hei!  :iaymi«tutic  (•erfom»;uic»»  ia 
li'e  ..m.i'.itor  more  i.ipaily,  suyKrttini;  that  Minulati-rs  \».;h  motuMi  may  provule  jisore 
fti  . o-n:  ira.nui.<.  iveii  if  not  more  eifeetue  tramm^  n >i’.i.'’cJwni Itio)  have  found 

ti'.at  ti'.e  lorrebtion  between  pilot  performance  in  an  .lacraft  ami  in  a uciutatur  increa-wi 
vvi.ii  the  addition  of  siraulitur  motion  cues  where  such  ciu's  help  the  pikit  in  I'opinit  with 
a dampevt  or  unstable  vehicle  or  u sliiKlfi^b  control  system,  ur  under  some 

cdcumsianctfs,  where  the  control  system  is  too  sensitive  Where  the  aitcialt  measy  tu  fly, 
however,  us  b the  case  with  the  aircraft  used  in  the  Jacolis  and  Huscmr  study  (Itper 
Cnerokee)  and  in  the  Air  Force  stuviy  (T-37),  motion  has  no  effect.  In  amither  NAS.A 
.study  (37)  of  the  eft.^cts  of  simulator  motion  on  pilots'  perioiinuiuv  of  a troc-Ivini;  task, 
the  rl^^ulU  from  a moving  flight  simulator  resembletl  tiie  results  from  flijtht  much  more 
th.1.1  did  those  from  a motionless  simulator.  Iluddh^ston  and  Kolfe(3S)  reported  that, 
us.n<t  simulators  without  motion,  experienced  pilots  ;ae  often  able  tu  achieve  iiccepUible 
■■  '<  ; t'rforrrance,  hi;t  th-^ir  pattens  of  control  -(•spr.-'-a*  show  that  their  performance 

IS  acnievevl  using  a strategy  ihffarenl  from  itiat  used  1;:  a vlya.t.iiic  Jmuun;* -.-nur.irment. 
Siiue  control  strategies  may  be  important  dunng  in  flight  emergency  maneuvers  when* 
transfer  of  training  re.search  b not  feasible,  it  would  e.ptiear  madeualittt  tu  eUminate 
motion  from  all  simulaturs  until  further  investigation  shows  the  generality  of  the  Jacobs 
aiul  Ko.>cue  findings.  At  the  present  time,  we  cannot  be  certain  of  the  rule  of  motum  in 
simulator  trainmg  effectiveness  and  efficiency. 

Handling  Characteristics.  Simubtors  built  with  the  technology  avaititite  two  ileeades 
ago  tended  to  have  hahdliniT characteristics  which  were  sometimes  quite  unit W those  of 
on  aircraft,  and  their  eff.'Ctiveness  was  liiiiiteil  largely  by  the  fact  that  (vitoU  resutetl 
traincig  in  them  or  would  use  them  only  «s  proceduriii  tr.iiners  (h).  There  were— and  .still 
are-strong  pilot  opLnions  that  a simulator  ha»l  to  “fo-r’  like  ;m  .iircraft  if  it  were  to  be 
effective.  Transfer  studies  of  individual  aircraft  control  p;.r.imeters,  such  as  .1  study  of  the 
correspomlence  in  stick  pmssures  lietween  a device  aiul  a tr.uning  aireral't  (30)  laileil  to 
len.l  support  to  the  pilots’  opinions.  Where  the  corrcsooiulcnce  NOween  the  d-vice  and 
the  aircraft  b gross,  however,  us  wa.s  found  in  one  vlevice  m winch  furwortl  pressure  on 
the  wheel  resulted  in  a climb  configuration  (10).  simulator  effectiveness  undoubtedly  will 
suffer.  Thus,  zJthough  in  the  extreme  case  simulator  rc.>ponse  characteristics  unlike  tho.->e 
of  the  aircraft  can  produce  negative  transfer  of  training,  there  is  little  evidenv-e  that  the 
simulator  must  precisely  duplicate  the  feel  of  the  aircraft  in  order  to  be  effevtive.  It  b 
(x-issible,  however,  that  even  minor  dissimilarities  in  fv'e)  or  tesponse  ruuU  leaii  to  the 
same  kinds  of  {xitentul  problems  found  in  simulators  without  nution,  t.e.,  tower 
correlation  between  simulator  and  flight  performance,  p.irtu  ularly  where  the  more  vltffi- 
cult  to  fly  aircraft  are  concerned. 

Our  understanding  of  simulator  design  features  in  relation  to  simutator  training 
effectiveness  b quite  limited.  It  is  clear  that  designing  a simulator  is  not  entirely  .a  matter 
of  duplicating  on  aircraft.  The  physical  correspondence  between  the  simulator  and  the 
aireraft  is  probably  mure  related  to  cost,  as  Miller  (-11 ) indicaleil  almust  two  dec.-ides  ago, 
ti’.im  to  training  effectiveness.  If  the  degree  of  corresponilenee  l>etwee«  the  diwice  and  the 
aircraft  is  relevant  to  the  objectives  of  the  intended  tr.uning,  training  ia  tlve  simulator  cim 
he  m.ide  effective— v hether  it  b or  not  is  a matter  related  to  other  factors. 
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Tiiii  ling  Programs 

Krfi^u^nt  nole  Im  bt^r;  taken  of  the  infliienc  * upon  training  effectiveness  of  the 
manner  m wh;ch  a simulator  i>  used.  Yet,  the  literature  is  full  of  reports  of  situations  in 
which  ti'.e  inportuiice  of  training  proitraiii  design  and  execution  seemed  to  be 
Ignored  le  g..  Although  there  is  an  incr.  a»ing  emphasis  upon  effective  use  of  devices, 
current  instances  can  be  cited  of  trauiiiig  crograms  in  w!uch  simulators  are  misused  or  are 
used  inefficiently.  Kven  in  simulator  effectiveness  research,  participating  instructors  often 
are  permitted  to  conduct  training  in  various  non -standardized  ways. 

list  all  traming  program  design  and  e.vecuUon  var.ables  which  potentially 
utiluerice  simulator  training  effectiveness!  would  be  an  almost  interminable  task.  Any  of 
ire  numerous  textbooks  on  human  learning  will  provide  a source  for  identification  of 
variables  which  influence  learning  and  performance,  e.g.,  schedules  of  re'aforcemer.t, 
meanirgfulness  and  difficulty  of  matetiai  to  be  learned,  size  of  teaming  blocks  and 
knowledge  of  result..  Klexman,  et  al.,  (27)  have  shown  how  such  variables  can  he 
employeil  to  increase  simulator  and  training  effectiveness. 

The  sequencing  of  simulator  an>l  aircraft  training  hais  lieen  suggested  as  a factor 
which  could  influence  the  effectiveness  of  simulator  training.  Smode.  et  al.  (2)  concluded 
that  the  evidence  concerning  whether  sequer.c’ng  is  irfluential  wa.s  inconclusive.  Meister, 
et  at.,  (11)  presented  data  which  suggest  that  switching  trom  the  aircraft  to  the  simulator 
reduces  performance  in  the  simulator  on  Ute  following  sessions,  resulting  in  a training 
iiefficiency.  While  there  may  he  some  inteiactive  effects  between  tlie  sequence,  the 
manner  in  which  the  device  is  used,  and  the  design  of  the  device  which  could  influence 
effectiveness,  it  vvoird  appear  quite  likely  that  training  in  the  aircraft  before  the  full 
lienefit  of  the  simi  ' itor  has  Inn'n  realized  with  respect  to  a particular  task  would  ter.d  to 
reduce  the  overall  efficiency  of  the  simulator-device  training  program.  In  an  unpublished 
instance  which  illustrates  this  view,  a fifty  training  hour  program  in  which  the  simulator 
was  Used  prior  to  training  in  the  aircraft  became  a £i.xty  training  hour  program  when  the 
sequence  was  changed  to  mix  simulator  and  aircraft  training,  although  other  changes  were 
introduced  concurrently  which  could  have  contributed  to  the  resulting  inefficiency. 

Training  program  content  is  an  obvious  influence  upon  simulator  training 
‘"‘•(‘A.  ’ .'  .\  dynum^’  f'i'’ht  simubfor  used  only  as  a procedures  trainer,  for  example, 
IS  not  O'-!:.;.,  vffectiv.'ly.  It  is  iJso  l!;  n siir.ula.'.T  trair.ir.p  prt-sented  in  ti,.’ 

context  of  simubted  mission  activities,  as  opposed  to  abstract  training  exercises,  tends  to 
he  more  effective,  and  the  literature  on  learning  and  forgetting  suggests  that  behavior 
learned  within  such  a meaningful  context  will  be  less  quickly  forgotten  (42). 

There  are  a number  of  other  training  program  factors  which  iuriuence  simulator 
training  efficiency  and  thus  would  lead  to  a higher  TEIl  value,  although  not  to  increased 
effectiveness  per  se.  Tliese  include  the  amount  of  simulator  training,  the  sequence  in 
which  '.nstruction  is  co'idu.'ted  in  the  simulator,  the  use  of  individual  (as  opposed  to 
group)  pacing,  training  to  specified  criterion  levels  (us  opposed  to  training  for  fixed  time 
periods),  and  the  extent  to  which  simulator  training  includes  tasks  which  can  be  learned 
more  efficiently  in  the  aircraft.  Smode,  ct  al.,  (2)  pointed  out  a decade  ago  that  little 
was  known  about  how  to  manipubte  such  factors  to  best  advantage.  That  observation  is 
still  valid. 


Personnel 

Simulator  training  involves  trainees  and  instructors.  Both  categories  of  personnel 
represent  potential  inHuenev;  upon  effectiveness.  ITic  most  ol’\'’Ously  relevant  considora* 
lions  v.iih  respect  to  both  are  their  qualifications  and  prior  experience,  but  occasionally 
Other  variabVs  ;'.re  suggcsti'd.  For  example,  Meister,  et  al.  (1 1),  found  a difference  in  the 
efroiLiv..n.-s.s  of  one  .simulator  tr.iining  program  for  student  and  operational  pi'otr,  vs. 
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rhi*  .»:tfil>L;ti‘»!  t>i  t i-m  .iil '..ilMJii  ■n..  h .iJUi 

i.u-tv*rv  which  prjc.il'lv  ui  i >mfu  tor  inoiiy  ti-il  '••uiini:..  n ii  -.tiKli*** 

'Ihc'  paper  wUi  liiiCUj*  im!y  th.*  mi*re  perMiiiiiei 

'rr:>in«*e»  AIJ  i.ueaCi;:atioii>  of  human  Ic'oniir.^  art*  !,iil>;«*cJ  to  the  loflueiu  . v of 
t-Ltk  retateil  aptituiie^  ol  th**  K’.tnier^  .\pti;'.iJe>  .;.v  c!t'rint<ii  in  term*  - f ^.•a^^!nJ^ 
cfficteacy,  utij  h.fch  aiit.tUue  ^:u.U*n:a  fcaia  ;s  iisore  rapi.Uy  .>r  t.i  i;r*Mler 

li  s’Tt'e  tha:i  do  Kiw  aptitude  >ti;di'nta.  Uhere  *h«*  t.ainiii^  projt.'a.Tt  mv-iives  .tiiutun^ 

of  -s.mulator  traininit  lime,  hijth  .iptituile  studenU  ',*.0.1  ?;uire  ijnk*  *..►  tr.u;di*r  to  the 
Oifcraft;  where  Irauiir^  to  performance  Icve!*  anil  traiiiiti):  tune  *anes,  tii^li  .uid 

low  aptitude  ttudenU  achieve  about  equally.  Im:  h!.,;h  .ipiitude  st*adant>  rc«;*a:r«‘  le>* 
troininit  time  in  the  simulator.  .A  itieuaure  of  simulator  trainui;;  erficuiicy  >uch  as  the 
TKR  will  yield  a hitther  value  for  h'yh  aptitude  sCudenta,  hut  this  doeii  not  indicate  that 
the  simulator  traininit  proioram  u more  effective  with  such  sCutlenU.  It  la  ptubuLly  tniually 
effective  with  both  itroups  of  students,  but  trunini;  time  in  the  device  wdl  t»e  shorter  for 
one  than  for  the  other.  Thus,  while  hitfh  aptitude  student*J  team  more  efticiently, 
aptitude  per  se  is  not  believed  to  be  an  inHueiice  upon  simulator  trumnx  eflectiveiiiss. 

The  influence  upon  simulator  trainuiK  offet  tiveness  of  level  of  tr.nmee  .skill  or 
amount  of  prior  ni^ht  experience  is  frequently  (jiiestioneil.  Many  i.iilicary  pilots  and 
nunaxers  acknowledge  that  simulators  provide  appropriate  tnuiiing  for  the  airlines,  where 
the  trainees  are  highly  er pent-need,  but  insist  tha*  the  tleivces  canrol  he  ndiisl  upon  as 
est.n.iveiy  to  frai.i  less  e.\penen»l^J  ::u!.:ary  p-iuts.  i'!i:*  .skills  {aiss^ssetl  bv  :i»-*.s«*  two 
(poups  of  trainees  do  differ,  qualitatively  a.s  well  as  quantitatively,  and  the  tasks  for 
which  they  ondecyo  training  are  not  identical.  Therefore,  the  training  they  receive  should 
not  be  identical  if  it  is  optimally  designed  to  meet  their  respective  trainuig  neetis.  and  the 
characteristics  of  the  .simulators  involved  m their  training  .should  vary  os  well,  tt  does  not 
follow,  however,  that  simulator  training  can  be  appropriately  ilesigneil  and  conducteii  for 
one  rxpenence  level  trainee  but  not  for  .mother.  In  fai  t,  the  exfierimentot  evtdeniv  does 
not  support  the  contention  that  simulator  training  effectivenoM  is  influencetl  by  level  of 
trainee  expeneniv  in  isolation  from  other  factors  After  reviewing  a large  number  of 
transfer  of  training  stu'lies,  Micheli  (d)  conchuled  th.it  flight  tnuning  devices  arc  ciTective 
for  both  neophyte  pilot  trainees  and  airline  pilots. 

Instructors.  After  renewing  the  literature  on  the  flight  mstriictor,  Smtule,  et  ol.  (2). 
concluded  that  experienced  pilots  do  not  make  Id-tter  in  flight  instructors  than 
Lnexperienceil  pilots.  The  same  conclusion  cm  be  extrapolated  to  simulator  instructors. 
While  the  evidence  is  skimpy,  it  ap(>eiirs  that  even  {vrsonnel  with  no  flight  exjrerit-nce  can 
be  trained  to  be  effective  simulator  instructors  For  c.xainple.  in  a simulator  training 
study  comparing  an  uistnictor  with  .s«‘vetal  thousand  hours  miliUiry  instnictor-pilot 
experience,  a recent  flight  training  program  pT.aduate.  and  a non  rateil  individual  with  a 
few  hours  dual  instruction  but  no  other  ueron.iuticjl  experience,  no  s:gnific.*ait  differences 
were  found  in  the  in-flight  performance  of  their  students  ( !;>>. 

There  is  some  evidence  that  not  uU  simuiaior  instiuctors  ore  equally  prt'pariHl  for 
their  job.  Hall,  et  al.  (5)  surveyed  a nu.tiher  of  military’  training  programs  and  found  that 
non-rated  enlisted  instructors  were  ill  prepared  as  compareil  with  pilots,  particularly  with 
respect  to  relevant  knowledge  of  the  aircraft.  They  also  noted  that  (liluts  were  similarly 
ill  prepared  with  respect  to  knowledge  of  the  capabilities  and  limitations  of  the  simu- 
lators. Since  no  transfer  data  were  reporteil,  it  cannot  tv  determined  whether  this  factor 
had  an  influence  upon  subsequent  in-flight  peiformance  in  favor  of  cither  type 
of  instructor. 

Muckier,  et  al.  (23)  observed  t.hat  in  some  ca.ies  a simulator  insiructor  miut  provide 
supplementary  information  about  the  in  flight  task  which  might  nut  be  available  to  a 
nor.-rated  instructor,  thus  presumably  tipping  the  sc.ile  in  favor  of  pilots  .is  simulator 
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instructors.  Muckier,  ot  al.,  aUo  noted  that  instructor  ability  and  fidelity  of  simulation 
are  related  in  such  fashion  that  as  fidelity  increases,  the  necessary  level  of  instructor 
ability  may  decrease,  and,  conversely,  as  fidelity  decreases,  instructor  ability  must 
increase.  This  relationship  would  tend  to  place  the  more  able  instructor  in  the  lower 
fidelity  simulator  where  a greater  amount  of  supplementary  information  might  be 
required.  It  has  been  my  observation  that  just  the  opposite  situation  often  obtains.  The 
more  experienced  pilots  instruct  in  high  fidelity  simulators,  while  less  experienced  and 
non^rated  personnel  instruct  in  older,  lower  fidelity  devices. 

Another  consideration  is  whether  there  should  be  one  instructor  or  two  in  a 
simulator  training  program.  That  is,  is  simulator  training  effectiveness  influenced  by 
whether  the  simulator  instructor  is  dso  the  in-flight  instructor?  While  this  variable  has 
not  been  isolated  for  study,  there  appears  to  be  an  increase  in  effectiveness  when  a tingle 
instructor  is  responsible  for  both  simulator  and  aircraft  training,  and  it  has  become  a 
standard  feature  of  the  simulator  training  programs  developed  by  my  organization.*  One 
apparent  benefit  is  that  the  instruction  given  in  the  simulator  is  more  compatible  with 
that  given  in  the  aircraft  when  only  one  instructor  is  involved,  thus  reducing  any 
potential  negative  transfer  attributable  to  instructor-peculiar  performance  requirements. 

It  often  has  been  assumed  that  the  instructor  is  an  important  factor  influencing 
training  effectiveness,  and  such  may  well  be  the  case.  If  so,  the  influence  must  be 
attributable  to  the  manner  in  which  the  instructor  functions,  i.e.,  to  non-standardization 
in  his  administration  of  the  training  program.  There  is  insufficient  evidence  available  at 
this  time  to  attribute  the  assumed  influence  to  instructor  experience  or  qualification  per 
se— assuming  he  has  undergone  an  instructor  training  program  appropriate  to  the  instruc- 
tional task  at  hand. 

Attitudes 

l\'hile  the  influence  of  simulator  design  upon  simulator  training  effectiveness  may 
hot  always  be  clear,  simulator  design  has  an  impact  upon  instructors  and  trainees, 
reflected  in  their  avtitudes,  which  in  turn  has  a large  influence  upon  simulator  training 
effectiveness.  Flexman  described  this  impact  as  follows  (quoted  in  23,  p.  69);  "Fidelity  of 
simulation  can  operate  as  a motivational  variable.  If  the  simulator  looks,  acU,  feels  and 
sounds  like  ni»*  airpluiio.  then  the  trr.inou  is  more  likely  to  he  convinced  that  prarMce  in 
the  device  will  be  beneficial  to  him."  In  circular  Ihshion,  attitudes  also  influence 
simulator  design.  WiUiges,  et  al.  (25)  noted  this  phenomenon  when  they  stated  that 
decisions  to  include  complex  and  expensive  motion  systems  in  simulators  are  invariably 
determined  by  pilots’  altitudes.  It  has  been  my  observation  that  fidelity  of  simulation  has 
a greater  impact  upon  the  attitude  of  the  simulator  instructor,  particularly  if  he  is  a pilot, 
than  it  has  upon  the  trainee,  and,  in  turn,  instructor  attitudes  concerning  simulator 
training  can  determine  trainee  attitudes. 

The  most  direct  effect  of  trainee  and  instructor  attitude  upon  simulator  training 
effectiveness  is  prohahly  upon  their  willingness  to  engage  in  simulator  training  in  the  first 
place.  That  is,  devices  which  are  viewed  favorably  seem  to  be  used  more  than  those 
which  arc  viewed  less  favorably.  If  the  addition  of  a motion  system  or  visual  display  to  a 
simidator  will  result  in  favorable  trainee  and  instructor  attitudes  toward  simulator  training 
and  hence  greater  utilization  of  the  device,  it  is  possible  that  more  effective  simulator 
training  will  result  from  the  greater  utilization,  oven  though  the  motion  and  visual  per  se 
may  contribute  nothing  directly  to  transfer. 


®Tho  siiii.lo  insirui  tor  concppl  has  h«'Pn  -jm-iI  pKewhue  ut  Ivasl  as  early  ns  Ihc  Inlc  1940*  (44). 
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It  u.iiilU  a nitftiaktf  ti.>  attriluitc  alt  laviumliU*  attitiiU«>>  litaanl  MuuilaU>r  Itauiiiiit 
Itt  htktU  (lilt^lUy.  'I'Mortf  art*  UtM  li.lchly  wliu'ii  art*  vi(*vwt*tl  favtttaUly  by 

many  Uaui<H*.t  aiul  .nitl  Mtunt  .>o|>!ii'.iu  atMl  tUrvav*  hake*  Utiti  ut^ilit;ii<*tl 

viabiwrably  by  v»{  tb#  ni'vtjtit*  um*iI  by  tlw*  |I.S  At  my 

as  .111  uislrumitnt  truumr  b'r  a iiiiiiibt'r  i*f  >«*ars  w.is  f\U>lttHl  by  tli»*  (li*vut‘  nistnii  tors, 
m.ilti;iit\l  by  tlixlit  iiutrurttir:*,  ami  tu'st-ribeti  v.irimisly  a<  a bf.ist  mhI  an  aul  by  li.i:iit*tis 
A itluily  of  ihit  vfftH'tivttMa^  of  lraiat:i|(  I'omhu  tttl  in  (lit*  tit'vu'i*  wait  lt*M»  .niibiKiutiu.  it 
was  llsflttsi  (7) 

KKtvpl  to  lb*  that  favorabt*i  attitmUw  imitMst*  ilt*vui«i  usf,  tlu*  efut  b of 

altstmly  upon  kiinulator  trainmit  appear  to  In*  prai'tically  nil  In  a stiuty  i>‘pt>iti*tl'  by 
Mm  kltir.  ct  ul.  (UU),  n»t{ativ«  attUmltm  lowanl  a tiainei  wtw  nulucnl  in  an  eitperiniiuital 
l,roup  by  ktrt*Min||  th«  tlevit'a'a  Uiw  fuielity,  while  positive  altitutire  were  iiiiliit'eU  in 
another  ^toiip  by  utresauin  the  same  devu  e's  trainuiK  efitH  tivenesa.  DuriiiK  transfer  triaU 
III  the  aircraft,  both  Ktoiip*  were  foiuul  to  have  belletltl^l.  atioiit  equally,  from  tile  ilevice 
tt  lining,  thu»  miiicatmg  that  the  nuliu'eit  negative  attitude  itul  not  affect  itevice  traiiung 
effectivenesa.  An  intereating  aspect  of  that  study  was  that  the  negative  attiliute  group 
rtspiireil  mure  training  m the  device  to  reach  cnteriun,  so  that  the  TKtt  value,  hail  that 
measure  of  effectivenwia  tieeii  a*  -d,  would  have  bt‘en  greater  fur  the  |KisitJve 
attitude  group. 

Nil  transfer  stmly  was  foumi  duri.'.g  the  current  ’.^•l|•*w  which  iiultcalt‘d  that  allitmld 
per  se  was  a factor  intiuencuig  simulator  eftectoeiievs  t>n  the  losis  of  my  own  ex|j«ri- 
emv,  it  appears  that  just  (he  reverse  may  be  tlie  lUse  simulator  training  effectivenesa 
innueiices  attitudes  tuwani  simulator  training  I have  oivserveil  abru|it  sliifU  ui  attitudes, 
paiticuarly  among  uislructurs  uml  training  program  managers,  following  demiNistratunia  of 
stn'.uUtot  effei-tiveness.  In  one  mstance.  uistnictors*  very  negative  nttitiules  tivwaril 
rei  need  .w'ale  paper  mockups  of  a coekpit  became  favoratde  when  they  titscovereil  that, 
unknown  to  them,  their  better  students  were  using  these  "ilevues"  mi  their  own  In  a 
stuviy  repoiteil  by  Meyer,  el  al.  (I),  pitots'  opinions  comernmg  smuilator  training  were 
found  to  be  morn  favorable  fcUowmg  their  paitictp.Uion  m an  effective  siniiilalor  iiuinmg 
progra.n  than  were  tlie  opinions  of  non  piutieipaling  pilot.s. 

In  spile  of  a lack  of  supporting  research  evidence,  there  U a t*Mrsen.siis  iiiiiong 
trainees,  instructors  uml  lulministrators  that  favouible  altilndes  toward  siniiilati.r  training 
increiLse  training  effectiveness.  'I'his  probably  is  coriis  t m the  .sense  Hut  more  exleii.sive 
use  will  lie  movie  of  simulators  if  they  ure  viewtsl  f.ivoralily.  It  may  lie,  however,  that 
attitmles  are  iiifliieneeil  more  by  Mimilator  (r.iuitug  effectivene.vs,  tliaii  the  other  way 
around.  A well  coiuUieCed  "lest"  of  the  Iriiinnig  ••ffectiieness  of  a snmilaloi  may  be  a 
very  influential  factor  m auitnug  that  its  training  wilne  will  lie  realized. 

Expectations 

Many  aviators  uerept  the  proposilum  that  training  m a Muuilatnr  mtv.hl  U*  helpful 
but  view  it  us  less  effective  th.m  training  m an  aircraft.  It  has  b,*en  iny  olwenatiou  that 
simulator  irainmg  adininistereii  under  the  cvinlrol  of  smh  imlividnali  luwer  es*  eetls  their 
expectations.  If  simulators  are  viewed  as  useful  tndy  as  proctHlnres  trainers  or  .-u  instru- 
ment trainers,  they  tend  tt>  lie  umhI  oidy  as  pr«icislure>  or  instrument  traniinrs,  even 
though  the  sam«  devices  might  In*  usevt  more  effvvtively  tiy  others  who  view  them  os 
offering  a greater  range  of  training  opportunities.  If  MimiUtors  ure  viewvst  as  useful  imty 
for  the  initial  stages  of  the  tievelopment  of  a parlicnl.ti  .skill,  to  tie  foHriwixl  by  further 
development  of  that  skill  in  the  aircraft,  siiiiiilator  tianiini;  is  less  efftx'tive  ihait  if  they 
are  viewed  as  substitutes  for  the  uireiafl  to  In*  ii.se«t  for  the  ilevtdopitwiit  of  a p.nticiilar 
skill  to  criterion  before  tran-sfemng  to  the  aircraft  While  kiinulator  training  may  not 
always  prove  as  effective  as  Mime  might  expect,  expeet.it ions  iipiiear  to  |4ai‘e  a limit  ii|Hiii 
realuixi  effectiveness  by  limiting  the  in, inner  and  extent  of  smiidalor  traiamg. 
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Kvpri'laliuns  cAu  innvn»mi»  simulalor  IraiitinK  vffoftivetiMS  ii\  more  Kubtls  ways  u 
W4*ll.  ri-.o  <>\pe(UUlnn  tl\at  4t  kiiniilulur  IraiiunK  proKTuin  will  prove  inoffvctive  can 
inRueiice  its  cvn\uution  in  lire  «*xpecl<Hl  iliri'otioii.  Uosearch  by  llosanthal  (45)  hu  shown 
that,  ov«n  wtUi  no  ir\l«nUon  lu  do  so,  tin  e\|H‘rimenttfr  iiinueiices  the  outcome  ot  his 
n'lMTiuch  in  the  tlirecUun  of  his  expectations.  Since  ntiuiy  "tests'*  of  the  effectiveness  ot 
simulatoi  truiniiiK  are  coiulucteti  hy  pilots  who  hold  strong  views  concerning  the  value  of 
.simulator  vs.  aircraft  tiainuig,  we  must  assume  that  their  expectations  cun  and  sometimes 
do  induent'e  tt\e  test  data.  In  those  instances  in  which  there  is  real  or  (lerceived  pressure 
from  a higher  authority  to  reach  a particular  finding  coneeming  the  utility  of  a particular 
simulator,  the  effect  might  he  even  greater. 

There  is  an  almost  infinite  number  of  factors  which  might  shape  expectations 
(oiuvrning  simulator  training  effectiveness.  An  obvious  itictor  is  (irior  experience  with 
simulator  training,  i'ho  more  favorable  opinions  of  piloU  toward  simulators  following 
participation  in  an  effective  simulator  training  progTam  were  noUnt  above.  Another  factor 
may  be  their  age.  Smovle,  «>t  al.  (2).  noted  that  older  pilots  lend  to  make  poorer  flight 
instructors,  poasibly  liecause  of  ti  hesitancy  to  nilupt  new  teaching  methods  such  os  the 
use  of  simulation.  Total  flight  time  is  prutMbly  also  n factor,  since  the  older,  more 
experienixid  pilots  uro  more  likely  to  have  h.nl  unsatisfactory  experiences  with  old 
simulators  and  typically  put  greater  confuh'iice  in  in-flight  training. 


INCntASING  SIMULATOR  TRAINING  LFFECTIVENESS 

It  is  unlikely  that  the  effectiveness  of  any  simulator  Inuning  program  can  be 
attributed  to  a singlo  influence.  Instead,  all  the  factors  discusseil  above,  end  probably 
many  mure  subtle  ones,  act  in  combination  to  proiluco  effective  Kiiiiulutur  training.  Keen 
factors  which  may  not  he  thought  influential  in  isolation  may  serve  iis  ratnlysta.  Effective 
siniulatur  training  defamds  upon  a prniM<r  eoinbiiiation  of  liiudware,  program,  pemonnel, 
and  other  factors. 

Although  progress  has  been  made  over  the  four  decades  since  Edwin  I.ink 
Introduceil  his  first  instrument  flight  Iruiner,  there  is  still  nn  element  of  uncertainty 
Involved  in  Ihe  desKpi  and  us«'  of  siiiiulalors  in  nus-ling  training  objectives.  Wheaton  and 
Mir;.l'iM'i:i  ( li’l  -.ii'lcd  Ih.il  Miiiui.dcr  di''i|:;ii'i.';  Ivoo  often  iiii';i>  a'‘lisi\ns  Ih.cl 

ItH'bniciuns,  and  because  of  the  informal  nature  of  the  inelbods  they  use,  it  is  diffieull  to 
reproduce  their  results  or  to  train  otbera  to  produce  effective  devii'cs.  The  same  comment 
«in  he  applied  to  training  pnigriini  developers.  |a'rhaps  to  nn  even  greater  degree.  There 
arc  artlsiins  who  devise  effect  ive  ways  of  using  snniiliiUiTS,  even  apparently  poorly 
desigmxl  simiiUdors,  hut  these  artisans  have  not  lieen  notably  siii  i’essrid  in  training  otheni 
to  provluco  effective  simulator  training  programs  t’onversely,  it  can  be  noUsI  that  others 
have  proilueed  juveious  little  in  the  way  tif  effectiveness,  even  though  working  with 
costly  simulators  of  up|iarently  excellent  design. 

White  simulator  training  artisans  can  sometinies  produce  specleculur  results,  there  are 
too  few  such  individuals  to  develop  niid  eonlinously  update  nil  of  the  simulator  training 
pmgTiims  reipiired  liy  mllilury  and  civilian  pilot  training  establishnienU  and  operational 
units.  The  present  paper  was  conceived  ns  iiii  attempt  to  liighlighf  some  considerations 
which,  if  nttendiHl  to,  might  lead  to  iiicrcase.s  in  siiuulalor  training  effectiveness.  It  may 
have  that  effect  in  some  iiisUinees,  but  I e.ai  not  conviiieiHl  that  our  picM-nl  data  bii.'se  i.s 
sufficient  to  that  objective. 

('learly,  more  n*»enrch  Is  neeileil  to  iiicreiuie  our  uiulerslaiiding  of  factors  innuencing 
simulnloT  training  effect ivcnes,s  Hut  » coneept uid  fiuiiiewnrk  which  could  make  l!ie 
conduct  Ilf  that  research  moie  efficient  and  relevant  to  generalir-ihte  jirolilem  soliilloi's  is 
I.K'kiog.  Hecniise  of  this  lack,  trainnii:  .spi'i  inliiits  have  no  llieorcin  ally  .icccptalilc  di  i-iin 
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t\>  fk>IU)\V  Kiul  IU>  t'llt't  I Ul‘l\lVk>  ^)al,s  tlk  MiUiv.  i lUl  IllXl  .'■I'tt  UUi>  U Itk  til''  Iv'l  t'l\t 
ii'.r.irvS  titvialvm'  vsliuli  will  jinni.li'  llu*  iiiuK'ipiniuiii^  (nr  U'lpiiri'il  .'.im'.iliiti'r 

training  ile»i)(ii$. 

I'liw'  t'rol>l«*iTi  \i  that  iMswftU'ieiU  iiifiirmalittii  i-.  I't'inn  <l\!.s«*imiiaU‘(l  aliuiit  lh«> 
nf  MiiuiUktoik  ai\U  tiaiiuiiK  pro^uunii-luith  offoi-tive  .mil  uii'tlci'livo  oiu's.  Mo.st  pulilishrul 
Miiuil.Uor  tratninti  rfse.mh  reports  state  the  uleutity  of  the  siinulalor.  the  espt'vimenUil 
ihii^lM  moilel,  and  the  resulU.  Often  iiifoimatum  i>  not  tiieluiUil  in  the  lepmt  oi 
otherwise  nvnilahle  nhoiit  the  simulator’s  (tesi)(u,  the  wav  it  was  iisesi,  tlw  iittitiiiles  and 
s'xpeeUtioMj  of  the  personnel  invsitveil,  and  other  faetoi.'.  whieh  should  he  of  interest  to 
someone  try'inH  to  apply  the  study’s  resulta  to  meet  operational  ttaininn  mipiireinenU. 
There  neests  to  be  mueh  iiune  emphasis  upon  hoie  the  lepoi  tisl  results  were  iiehieviHl. 

Attempts  to  apply  resenreh  results  itr  the  design  of  sunalutors  and  traiiunK  proarnins 
are  iin|H>rtant,  but  greater  l>eneftt  van  tie  derivesl  from  study  of  evisling  deviees  and 
programs  to  locate  features  svhich  can  be  adopted  in  new  simulator  training  programs 
under  development.  Tiie  most  useful  moilel  to  follow  in  the  ilevelopinent  of  effective 
simulator  tmininii  is  that  provtdeil  by  an  existing  application,  imxhfnxl  to  incorporate 
features  from  other  such  models  as  seems  appropriate. 

The  sinrulator  training  practitioners  and  lesearcliers  alike  need  more  case  study 
reports  of  simulator  training  npplicutnms.  Such  case  studies  would  serve  two  purposes, 
tl'.ev  would  prrivule  models  to  lie  followed  m other  applu  a’.iono  and  they  would  I'liweiil 
df'.igii  lUta  which  cou'.il  then  he  ussenihltHl  uiul  studied  in  effiirl.s  to  develop  I'l'Ui'eplii.il 
models  for  future  applications  and  to  guide  research 

While  I do  not  mean  to  relegate  research  to  u lesser  position  of  imiHirtiuice  in  onr 
efforts  to  increase  simulator  training  effectiveness,  I feel  that  there  iietnls  to  lie  more 
cmph.isis  at  the  present  time  upon  gathering  d.ita  about  existing  simulators  and  training 
programs  so  that  a better  conceptual  framework  can  be  developed  for  such  lesearcb.  Our 
theories  need  to  rest  upon  a broailer  data  tiase-  data  which  is  ilenvahle  from  piesent 
applications.  At  the  present  time,  there  needs  to  be  inoie  u.se  of  llie  scientific  method 
calleil  naturalistic  oh.Herv.ation  so  that  a tiromler  rlata  base  e.m  be  developed.  I’mhaps  the 
first  stop  is  to  recognise  a need  for  belter  communitation  among  practitioncrv  and 
researchers  about  the  nature  of  effective  simulator  Irainini!  Such  n step  cinild  lend  to 
Incrcasetl  simulator  training  iTfectiveiie.ss  through  greater  f.iinili.irity  with  the  piocevses 
involveil  in  simulator  training. 
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